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Abstract 

In  this  paper  we  examine  how  simple  agents  similar 
to  Braitenberg  vehicles  can  exhibit  chaotic  movement 
patterns.  The  agents  are  wall  following  robots  as 
described  by  Steve  Mesburger  and  Alfred  Hubler  in 
their  paper  “Chaos  in  Wall  Following  Robots” .  These 
agents  uses  a  simple  forward  facing  distance  sensor, 
with  a  limited  field  of  view  (<i>)  for  navigation.  An 
agent  drives  forward  at  a  constant  velocity  and  uses 
the  sensor  to  turn  right  when  it  is  too  close  to  an 
object  and  left  when  it  is  too  far  away. 

For  a  flat  wall  the  agent  stays  a  fixed  distance  from 
the  wall  and  travels  along  it,  regardless  of  the  sensor’s 
capabilities.  But,  if  the  wall  represents  a  periodic 
function,  the  agent  drives  on  a  periodic  path  when 
the  sensor  has  a  narrow  field  of  view.  The  agent’s  tra¬ 
jectory  transitions  to  chaos  when  the  sensor’s  field  of 
view  is  increased.  Numerical  experiments  were  per¬ 
formed  with  square,  triangle,  and  sawtooth  waves  for 
the  wall,  to  find  this  pattern.  The  bifurcations  of  the 
agents  were  analyzed,  finding  both  border  collision 
and  period  doubling  bifurcations. 

Detailed  experimental  results  will  be  reported  in 
the  final  version. 
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1  Introduction 

In  this  paper  we  look  at  how  a  simple  wall  following 
system  leads  to  chaos,  when  modeled  as  a  mathe¬ 
matical  system.  This  shows  the  importance  of  un¬ 
derstanding  chaos  in  the  creation  of  artificial  intelli¬ 
gences  for  robots.  The  model  was  originally  described 
in  the  paper  “Chaos  in  Wall  Following  Robots”  by 
Steve  Mesburger  and  Alfred  Hubler.  A  model  for 
a  simple  wall  following  robot  was  described  and  it 
was  shown  that  when  following  a  sinusoidal  wall  the 
robot’s  behavior  would  undergo  a  transition  to  chaos 
via  period  doubling  as  the  robot’s  field  of  view  in¬ 
creased  [2].  In  this  paper  we  extend  this  research  by 
walls  with  discontinuous  corners  and  show  that  the 
robot  still  experiences  a  transition  into  chaos. 

2  Model 

The  model  for  this  simulation  is  small  robot  agent 
with  an  independent  drive  train  and  a  simple  forward 
pointing  boundary  sensor  [2.  An  independent  drive 
train  0  allows  the  vehicle  to  turn  in  place  by  driving 
the  wheels  on  each  side  in  opposite  directions.  The 
boundary  sensor  is  only  able  to  minimum  distance  to 
the  boundary  and  not  the  shape  or  direction  of  the 
boundary. 

Furthermore  the  sensor  has  field  of  view  limited 
to  2<I>.  Where  is  one  of  parameters  varied  in  the 
experiment. 

The  most  unrealistic  part  of  this  robot  is  that  it 
can  change  its  angular  velocity  (the  rate  at  which  it  is 
turning)  instantaneously,  allowing  the  robot  to  switch 
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from  a  hard  left  turn  to  a  hard  right  turn  and  back. 
This  can  happen  when  the  robot’s  sensor  detects  a 
wall  at  the  edge  of  it’s  vision  and  then  turns  or  moves 
away  from  the  wall.  This  is  not  physically  possible 
but  as  long  as  the  speed  is  low  this  approximates  how 
real  vehicles  behave.  For  the  purpose  of  modeling 
the  robot  also  maintains  a  constant  velocity  which 
we  convivially  set  to  one. 

As  such  the  robots  position  can  be  represented  by 
an  (x,y,6)  vector  where  9  is  the  counter-clockwise 
angle  of  the  robot’s  direction  of  travel  from  the  pos¬ 
itive  x-axis.  The  velocity  of  the  robot  is  represented 
by  V  and  the  angular  velocity  is  uj.  (this  makes  the 
last  equations  somewhat  trivial)  The  robot  can  the 
be  represented  as  a  series  of  deferential  equations  [2] . 


dx 

dt 

dt 

60 


vcos6 
V  sin  9 


dt 


=  U! 


(1) 

(2) 

(3) 


Also  the  model  dose  not  enforce  the  boundary  by 
preventing  the  robot  from  crossing  it.  So  it  may  be 
better  to  think  of  the  boundary  as  the  edge  of  a  no 
entry  zone  for  the  robot  instead  of  a  physical  barrier. 

The  boundary  is  modeled  as  one  of  the  waves.  The 
wave  travels  along  the  X  axis  with  an  amplitude  of 
one  and  a  wavelength  (A)  of  10.  There  waves  are 
studied  in  this  paper,  the  square  wave,  the  triangle 
wave  and  the  sawtooth  wave.  A  sinusoidal  wave  has 
been  studied  previously  [2]. 

These  waves  can  be  represented  using  the  following 
equations. 


ysawtoothi^^^  —  ^ 

(4) 

ytriangie{x)  =  arcsin(sm(x)) 

(5) 

ysquarei,^^  — 

(6) 

However,  for  efficiency  of  the  calculations,  and 
because  the  boundaries  the  vertical  disjoint  parts 
of  the  wave  are  part  of  the  boundaries  each  wave 
was  represented  as  a  series  of  points  represent¬ 
ing  one  period  of  the  wave.  (Actually  more  than 
one  period  is  represented  to  avoid  issues  with 


Figure  1:  Four  common  types  of  waves.  The  triangle, 
square,  and  sawtooth  waves  were  the  focus  of  this 
study. 


the  robot  around  the  boundaries.)  For  exam¬ 
ple  the  square  wave  with  A  being  the  wavelength 
was  represented  by  the  following  series  of  points. 
(-.5A,  -1),  (0,  -1),  (0, 1),  (.5A,  1),  (.5A,  -1),  (A,  -1) 


3  Procedures 

A  model  for  the  robot  was  created  using 
Mathematica"'’^ .  Each  step  of  the  robot  was 
calculated  using  Runge-Kutta  4  with  a  At  =  0.1. 
Smaller  values  for  At  did  not  improve  the  results 
significantly. 

The  largest  calculation  of  the  problem  it  to  deter¬ 
mine  the  sensor  value,  or  the  minimum  distance  to 
the  boundary.  For  the  each  segment  of  the  wall  with 
the  robot’s  range  the  closest  point  to  the  robot  was 
calculated  as  well  as  any  intersections  with  the  edges 
of  the  robot’s  field  of  vision.  The  closest  of  all  these 
points  was  then  used  to  calculate  the  sensor  value. 

R  represented  the  maximum  range  of  the  sensor,  r 
represented  the  range  at  which  the  robot  would  move 
straight  or  how  far  it  tried  to  say  away  from  the  wall. 
A  scaling  value  a  of  the  angular  velocity  might  also 
be  appropriate.  Finally  $  was  half  of  the  robot’s 
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angular  vision,  it  could  range  (0,7r].  R  was  taken  to 
be  4,  r  was  taken  to  be  3,  and  a  was  taken  to  be  1.0 

The  results  were  then  graphed  on  X-Y,  X-0,  Y-0. 
With  the  X  values  were  taken  modulo  A  (10)  so  that 
they  coincided  with  the  period  of  the  boundary. 

3.1  Calculation  of  Sensor  Value 

In  order  calculate  the  closest  point  on  the  boundary 
to  the  robot  agent  with  in  it’s  sensor  range  several 
different  distances  were  calculated  and  the  minimum 
of  them  was  used.  The  first,  trivially,  distance  is  the 
maximum  range  of  the  sensor  R.  Secondly  the  dis¬ 
tance  to  each  selected  points  on  the  boundary  that 
have  been  tested  to  be  in  the  robot’s  sensor  range. 
These  points  are  divided  into  two  further  groups, 
points  on  the  intersection  of  the  boundary  and  the 
edge  of  the  robot’s  vision,  and  the  closest  point  on 
each  segment  to  the  robot’s  location.  It  can  be  shown 
that  these  points  will  always  contain  the  closest  point 
to  the  robot  within  its  vision. 

The  point  on  a  segment  closest  to  another  point 
(the  robot’s  location  in  this  case)  was  found  us¬ 
ing  parametric  equations  to  reduce  machine  round¬ 
ing  errors  and  minimize  the  calculation  time. 

|(,  ,,)x(p-.,)l  ^  y  Then: 

S2-S1  I 

{Si  if  M  <  0 

S2  if  M  >  1 

(s2  —  si)u  -I-  Si  i/0  <  u  <  1 

These  points  are  then  tested  to  make  sure  that  they 
have  the  right  angle  from  the  robot  to  be  seen  by 
its  sensors  and  are  close  enough  to  the  robot  to  be 
seen.  Point  that  are  not  in  the  robots  sensor  range  are 
removed.  Each  segment  is  then  tested  to  see  if  any 
point  on  it  intersects  with  either  edge  of  the  robot’s 
sensor  range.  The  intersection  of  segments  {pi,p2) 
and  (p3,P4)  was  then  found  by:[T]. 

{X4  -  X3){yi  -  ys)  -  (?/4  -  y3){xi  -  xs) 

u  ^  - 

(?/4  -  y3)ix2  -  a;i)  -  ix4  -  X3){y2  -  yi) 

(7) 

intersection  =  pi  +  u{p2  —  pi)  (8) 


saw  4>=Pi 
64 


Figure  2:  Plot  of  the  robot  following  a  sawtooth 
wave,  when  $  =  l/647r.  Notice  how  the  robot  is 
willing  to  follow  the  straight  segment  as  long  as  it 
goes. 


1.0 


-2.0 


Figure  3:  Plots  of  the  xy  movement  when  the  sensor 
range  =  l/647r,  i?  =  4  and  r  in  the  range  [1.5, 3.5]. 

4  Numerical  Results 

The  tree  different  boundary  waves  all  followed  the 
same  pattern  as  increased  from  0  to  tt  When  4) 
was  close  to  zero  the  robot  tends  to  hug  the  wall  very 
closely.  In  places  where  the  is  a  long  straight  wall 
with  no  obstacles  you  can  see  the  robot  follow  the 
wall  all  along  it’s  path.  The  figures  here  were  made 
by  taking  the  point  form  each  time  step  and  plotting 
{x  mod  A,  y)  where  A  =  10  in  this  case.  You  also 
see  the  robot  tends  to  head  directly  for  corners,  just 
narrowly  passing  them  and  then  quickly  stabilizing 
on  the  segment.  Furthermore  as  R  remains  constant 
decreasing  r  causes  the  robot  to  follow  the  wall  more 
closely.  However  when  r  =  R  the  robot  no  longer 
turns  counter  clockwise.  Similarly  when  r  =  0  the 
robot  will  only  turn  counter  clockwise.  Both  of  these 
cases  are  less  interesting  as  the  robot  tends  to  either 
go  in  circles  or  drive  off  in  a  straight  line. 

As  the  value  of  4>  increases  robot’s  path  becomes 
slightly  chaotic.  While  the  robot’s  path  remains  in  a 
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Figure  4:  Path  of  robot  against  the  sawtooth  wave 
show  in  experience  chaos  even  at  low  values  of 


Figure  5:  Cobweb  diagram  of  the  robot’s  y  position 
when  as  it  passes  a  point  where  x  mod  A  =  0.  The 
plot  show  log(2/  +  2.65)  as  this  makes  the  lower  left 
hand  section  of  the  graph  easier  to  read. 

very  narrow,  and  stable  channel  within  that  channel 
the  path  is  chaotic.  With  the  sawtooth  wave  this  be¬ 
havior  becomes  most  pronounced  when  $  197r/64 

Verhulst  diagrams  or  more  commonly  cobweb  plots 
were  created  of  a  single  path  to  better  view  robot’s 
behavior.  To  do  this  a  point  from  each  period  of  the 
robot’s  path  was  selected.  For  simplicity  the  points 
were  when  the  x-coordinate  was  a  multiple  of  the 
wavelength  of  the  boundary.  Then  either  the  y  or  9 
values  could  be  used  to  make  the  Verhulst  diagram. 
The  y  value  was  chosen  arbitrary. 

In  fact  it  was  found  that  the  robot  tends  to  exhibit 
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Figure  6:  A  Bifurcation  diagram  of  sawtooth  wall 
showing  a  transition  to  chaos  through  period  dou¬ 
bling 

this  chaotic  behavior  even  at  low  $  where  it  appears 
stable.  This  may  be  a  property  of  having  sharp  cor¬ 
ners  in  the  boundary  wave  that  are  not  present  in  a 
sinusoidal  wave. 

For  all  three  waves  the  chaotic  patterns  appeared 
to  die  down  around  $  «  .Stt.  Then  after  that  all  three 
waveforms  undergo  a  transition  to  chaos.  To  view  the 
transition  bifurcation  diagrams  were  created  for  each 
type  of  wall.  Like  the  Verhulst  diagrams  the  value 
of  y  at  the  when  a;  is  a  multiple  of  A(10)  were  taken 
from  each  simulation  of  the  robot.  The  first  30%  of 
the  values  were  discarded  to  ensure  that  the  system 
and  converged  to  it’s  attractor. 

The  sawtooth  boundary  produced  an  period  dou¬ 
bling  bifurcation  diagram.  Where  the  full  transition 
to  chaos  occurred  when  4>  w  121/1287r  However  an 
exception  was  also  found  when  $  =  15/167r.  The 
robot  moved  in  the  negative  direction  by  turning 
counter  clockwise  in  ellipses.  It  may  be  that  this  is 
another  attractor  for  the  sawtooth  boundary  regard¬ 
less  of  the  <I>  value. 

When  the  robot  was  following  a  triangle  wave  it 
was  found  that  the  9  values  provided  a  better  bi¬ 
furcation  diagram  than  the  y  values.  The  triangle 
wave  boundary  first  cause  chaotic  behavior  around 
4)  w  3/167r  The  sharp  disconnect  when  4)  w  3/47r  in 
the  bifurcation  diagram  appears  to  be  an  indicator  of 
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sa«,*=15Pi 


Figure  7:  A  plot  of  the  robot’s  movement  backwards 

along  a  sawtooth  boundary.  Figure  8:  A  Bifurcation  diagram  of  triangle  wall 


a  second  attractor. 


The  square  boundary  gave  results  looking  more 
similar  to  that  of  the  triangle  wave  then  the  sawtooth 
wave.  It’s  first  expression  of  chaos  occurs  around 
<!>  «  7r/4  Also  around  4)  «  49/647r  it  too  has  a  dis¬ 
connect,  with  initial  starting  values  of  (0,  — 2,0).  In 
order  to  make  the  bifurcation  diagram  simulations 
were  run  for  each  <I>  value  with  a  starting  points  at 
(0,  y,  0)  where  for  every  half  unit  between  —1  and  —5. 
These  two  strange  attractors  actually  curl  around 
each  other  when  visualized  in  3d. 


5  Conclusion 

In  this  work  it  was  show  that  the  behavior  of  a  simple 
control  system  can  under  go  a  chaotic  transition  from 
a  change  in  the  environment.  A  consistent  pattern 
was  still  observable  through  out  these  changes. 

Further  improvements  to  the  algorithm  could  be 
made  by  creating  a  spatial  hash  table  of  segments 
that  maps  the  location  of  the  robots  to  a  list  of  seg¬ 
ments  that  are  with  in  the  range  of  the  robot.  This 
would  reduce  the  number  of  tests  the  simulation  per¬ 
forms  by  as  much  as  50%. 


Y 
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Figure  9:  A  Bifurcation  diagram  of  Square  wall 
showing  a  very  sharp  transition  around  O  =  ^  «  2.3 
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Figure  10:  A  Poincare  Plot  of  the  y  and  6  values 
when  X  is  multiple  of  10. 

6  Future  Work 

Further  work  beyond  optimizations  of  the  algorithm 
involve  adding  additional  robot  agents  for  make  a 
swarm.  The  swarm  of  wall  following  robots  would 
interact  with  each  other  and  the  wall,  which  leads  to 
a  rich  dynamical  system.  Research  on  the  conditions 
when  the  swarm  behaved  chaotically  and  when  it  did 
not  would  be  done. 

•  Build  a  swarm  of  wall  following  robots 

•  Experiment  with  different  cognitive  behaviors  in 
the  agents 

•  Use  agents  with  differing  abilities  in  both  sensors 
and  cognition 

•  Combine  real  and  virtual  robot  agents  in  a  sim¬ 
ulation 


References 

[1]  Thomas  H.  Cormen,  Charles  E.  Leiserson, 
Ronald  L.  Rivest,  and  Clifford  Stein.  Introduc¬ 
tion  to  Algorithm;  2nd  Ed.  McGraw  Hill  Book 
Company,  2001. 


[2]  Steve  Mesburger  and  Alfred  Hubler.  Chaos  in 
wall  following  robots.  September  2006. 


6 


